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Abstract 


E-learning has become an increasingly important teaching and learning mode in educational 
institutions and corporate training. The evaluation of e-learning, however, is essential for 
the quality assurance of e-learning courses. This paper constructs a four-phase evaluation 
model for e-learning courses, which includes planning, development, process, and product 
evaluation, called the PDPP evaluation model. Planning evaluation includes market demand, 
feasibility, target student group, course objectives, and finance. Development evaluation 
includes instructional design, course material design, course Web site design, flexibility, 
student-student interaction, teacher/tutor support, technical support, and assessment. 
Process evaluation includes technical support, Web site utilization, learning interaction, 
learning evaluation, learning support, and flexibility. Product evaluation includes student 
satisfaction, teaching effectiveness, learning effectiveness, and sustainability. Using the 
PDPP model as a research framework, a purely e-learning course on Research Methods 
in Distance Education, developed by the School of Professional and Continuing Education 
at the University of Hong Kong (HKU SPACE) and jointly offered with the School of Dis¬ 
tance Learning for Medical Education of Peking University (SDLME, PKU) was used as a 
case study. Sixty students from mainland China, Hong Kong, Macau, and Malaysia were 
recruited for this course. According to summative evaluation through a student e-learning 
experience survey, the majority of students were very satisfied/satisfied on all e-learning di¬ 
mensions of this course. The majority of students thought that the learning effectiveness of 
this course was equivalent, even better, than face-to-face learning because of cross-border 
collaborative learning, student-centred learning, sufficient learning support, and learning 
flexibility. This study shows that a high quality of teaching and learning might be assured 
by using the systematic PDPP evaluation procedure. It is hoped that the PDPP evaluation 
model and its application can provide a benchmark for establishing a wider e-learning qual¬ 
ity assurance mechanism in educational institutions. 
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Introduction 


E-learning has become widely used in conventional education, continuing education, adult 
education, and corporate training because of its flexibility, richness, resource-sharing, 
and cost-effectiveness. United Nations Educational, Scientific and Cultural Organization 
(UNESCO) statistics show that over 455 million people around the world received educa¬ 
tion and training through the Internet in 2008. Over 70% of universities in the USA were 
providing e-learning courses, and more than 6.1 million university students were taking at 
least one e-learning course during the fall 2010 term, which accounted for over 31% of the 
total number of university students in the USA (Allen & Seaman, 2011). 

The financial crisis in 2009 led to a significant increase in student enrollment in e-learn- 
ing colleges in mainland China, some of which even had increases of 20%. The continu¬ 
ing education departments in China’s universities are gradually merging with e-learning 
colleges and providing continuing education programmes to their adult students through 
e-learning. With the rapid development of information and communication technology, 
student attitudes towards e-learning are becoming more positive. For example, according 
to the Survey on the Demand for Continuing Education in Hong Kong 2007-2008, 40.4% 
of the respondents showed positive attitudes to e-learning when they considered pursuing 
a continuing education programme, while 83.9% of them hoped to try the blended learning 
approach. 

The economic benefits of e-learning are also becoming visible. For example, China Distance 
Education Holdings Limited in Beijing launched its first e-learning accounting course about 
10 years ago in the name of China E-learning Accounting Website. Now with millions of 
students enrolled across the country every year, it generates a huge profit for the company, 
and about a year ago it was listed on the New York Stock Exchange (Chinaacc, 2009). An¬ 
other example is that The Hong Kong and Shanghai Banking Corporation Limited (HSBC) 
transformed 30% of its training programmes into e-learning programmes in 2008, which 
cut its annual training expenditure by 15%; in 2009, HSBC planned to raise the percentage 
of e-learning training to 50 (Hu, 2009). 

With the rapid development of e-learning, there is also an increasing interest in e-learning 
research. Among all the research topics, quality assurance of e-learning has attracted the 
greatest concern. Jung et al. (2011) found that various national, regional, and international 
initiatives have been undertaken with regard to quality assurance in e-learning. Endean et 
al. (2010) stated that those concerned about online learning have been developing and pub¬ 
lishing ideas for over a decade about how to manage the quality of the learning experience 
of those trying to study through the Internet. 

However, Jung and Latchem (2007) found that most institutions apply the same quality 
criteria for e-learning as for the other modes of delivery. Endean et al. (2010) pointed that 
new entrants to the e-learning field were unlikely to have existing internal procedures to 
cover quality assurance of this new mode of operation. The adoption of a set of quality stan¬ 
dards that carry some wider recognition addresses the need for internal processes. 
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Course quality is assured by a series of evaluations, and e-learning should be no exception. In 
this paper, the authors propose an e-learning course evaluation model for quality assurance 
and analyze its concrete application using a cross-institutional purely e-learning course. 

Construction of an E-Learning Course Evaluation Model 

CIPP, which is a frequently used evaluation model in the field of social sciences, is the acro¬ 
nym for context, input, process, and product evaluation (Zhang & Jiang, 2007). Referring 
to the CIPP evaluation model and characteristics of e-learning courses, the authors propose 
a system for evaluating e-learning courses that consists of four evaluation activities: plan¬ 
ning evaluation, development evaluation, process evaluation, and product evaluation; in 
short, the PDPP model. 

Based upon the proposed PDPP model and in line with the components and e-learning 
characteristics, the e-learning evaluation model consists of 26 items (see Figure 1). 



Figure 1. The PDPP evaluation model for e-learning courses. 

Figure 1 shows that the planning evaluation of e-learning courses begins with market demand 
analysis and feasibility analysis. Market demands refer to needs of target student groups 
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for knowledge and skills in their careers. If courses are job-related, employer perspectives 
on the essential needs of their employees also need to be considered. If a course is to be ex¬ 
ported to other countries, it is necessary to analyze their local educational import policies, 
regulations, and levels of technical support. Then one needs to analyze the target student 
group, course objectives, financial issues, and quality assurance mechanism. Analysis of 
target student groups includes age range, educational background, work experiences, work 
hours, study time availability, learning motivations, and job requirements. If the exported 
course is to be jointly launched with local educational institutions, the quality assurance 
system of the partner institution needs to be analyzed as well. 

Development evaluation of e-learning courses involves analyzing every component of 
course development, including the course blueprint, e-learning platform, course Web site, 
instructional design, learning resources, assignments and examinations, and tutors. 

Development evaluation is a process corresponding to eight activities of e-learning. Accord¬ 
ing to the research findings of Zhang and Wang (2005), evaluating the e-learning teaching 
process should include the following eight dimensions: overall evaluation, technical sup¬ 
port, Web site utilization, student-student interaction, resources utilization, learning evalu¬ 
ation, learning support, and flexibility. 

Product evaluation measures the learners’ degree of satisfaction, teaching effectiveness, 
learning effectiveness, and any other possible additional outcomes. In the end, the sustain¬ 
ability of courses will depend on the results of the abovementioned analyses. 


Application of PDPP Evaluation Model 


This section describes the application of the PDPP evaluation model through a case study 
of an e-learning course on Research Methods in Distance Education. 

Case: E-Learning Course on Research Methods in Distance 
Education 

The e-learning course on Research Methods in Distance Education was developed by the 
School of Professional and Continuing Education at the University of Hong Kong (HKU 
SPACE) and jointly launched with the School of Distance Learning for Medical Education 
of Peking University (SDLME, PKU). HKU SPACE was mainly responsible for providing 
the learning materials including the textbook, e-learning study guide, study units, e-learn¬ 
ing courseware, study timeline, selection and training of tutors, quality assurance and copy¬ 
right protection, and the award of attendance certificates. The SDLME, PKU was respon¬ 
sible for e-learning platform design, development and management, student recruitment 
and management, tutor management, technical support, and learner support services. 

The Research Methods in Distance Education course consists of five units with ten chapters 
(see Table 1). 
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Table l 


Course Structure of Research Methods in Distance Education 


Unit 

Chapter 

Unit 1: Introduction to research 

Chapter 1: Distance education research methodology 

methods in distance education 

Chapter 2: Rationale of the distance education research 

Unit 2: 

Chapter 3: Literature collection and analysis 

Literature review and research 
design 

Chapter 4: Research design in distance education 

Unit 3: 

Chapter 5: Questionnaire and interview 

Research methods in distance 

education (1) 

Chapter 6: Delphi and cost analysis 

Unit 4: 

Chapter 7: Ethnography and policy analysis 

Research methods in distance 

Chapter 8: Action research, design research, compara- 

education (2) 

tive research, evaluation research 

Unit 5: 

Writing a research proposal and 
research paper 

Chapter 9: Writing a distance education research 
proposal 

Chapter 10: Writing a distance education research paper 


The course lasts 10 weeks and the average study hours are about eight per week, 80 hours 
altogether. All the teaching, learning, activities, quizzes, assignment, and discussion ses¬ 
sions take place in e-learning mode. One tutor is allocated to every 20 students. The stu¬ 
dents’ learning procedure is as follows: read the study guide; understand the learning ob¬ 
jectives; watch the video lectures (streaming media courseware); read the study unit; read 
related chapters in the textbook; participate in the e-learning discussion; read the summary 
of e-learning discussion prepared by the tutor, and write assignments. 

Planning Evaluation 

It is necessary to analyze the market demand, feasibility, course objectives, target student 
groups, finance, and quality assurance when preparing an e-learning course plan. This 
is a standardized process in HKU SPACE, which involves writing a course development 
proposal and filling in various forms that will be discussed and decided upon by different 
academic boards, the registrar’s office, and the finance department. 

Market demand analysis. 

This e-learning course has a huge potential market demand in Chinese language speaking 
areas, especially in mainland China. Considering the shortage of courses in this area in 
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Chinese regions, the main target student group would be academic staff in distance educa¬ 
tion institutions. For example, under the China Open University System, there is one China 
Central Radio & Television University (CCRTVU), 44 Radio & Television Universities at 
provincial level, 1,103 Radio & Television Universities at prefecture and city level, and 
1,853 study centres at county level (Development and Planning Office of CCRTVU, 2011). 

With the rapid development of distance education and e-learning teaching mode, more and 
more distance education managers and practitioners are beginning to recognize the impor¬ 
tance of research activities in enhancing teaching effectiveness and raising their univer¬ 
sity’s reputation. Academic research has also become an important index in the evaluation 
of distance education institutions, but high-quality academic research remains the weakest 
link in most such institutions. This is mainly because most distance education practitioners 
lack the necessary knowledge, skills, and experience of educational research. Therefore, 
they urgently need to acquire that knowledge and study the skills of distance education 
research in a systematic way. 

Feasibility analysis. 

Since the major market for this course is mainland China, HKU SPACE chose to collabo¬ 
rate with the School of Distance Learning for Medical Education of Peking University in 
order to achieve good cost-effectiveness. This school is one of the top e-learning education 
institutions in mainland China. Moreover, it has also had successful experience of cooper¬ 
ating in e-learning courses with the Open University UK. 

Target student group. 

Students come from Chinese speaking countries or areas like mainland China, Hong Kong, 
Taiwan, and Macau, among others. Researchers, managers, and teachers from radio and 
TV universities, e-learning colleges, open universities, and continuing education colleges 
who satisfy the following two requirements are qualified to study this course: having a col¬ 
lege diploma and having two years working experience in the field of distance education. 

In most open education institutions in Chinese regions, the academic staff members are 
encouraged to take on-the-job training in their professional areas. They could apply for 
sponsorship as well as leave from their own universities. The University could also assign 
some staff to take relevant courses as a part of staff training and development. It is expected 
the tuition fee of students would be paid by their institutions. 

Course objectives. 

The objectives of this course are set based upon the analysis of the course content structure, 
market demand, and target student group. Generally speaking, by the end of the course, 
the learners will be able to understand the methodology of distance education research; 
understand the rationale of distance education research; understand the process of dis¬ 
tance education research; collect and analyze literature in the field of distance education; 
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conduct research design for distance education research; apply distance education research 
methods; write a distance education research proposal; and write distance education re¬ 
search papers. 

In order to help students arrange study time before the course started, a timeline was 
proposed to guide students as follows. 

Table 2 


Study Time Arrangement for Research Methods in Distance Education 


Unit 

Chapter 

Week 

Self-study hours 

Online dis¬ 
cussion 

(hours) 

Study 
hours in 

total 

Opening ceremony 

Introduction of the course 

Use of e-learning platform 

1 

3 

4 

7 

Unit 1 

1 

2 

3 

3 

10 

2 

2 

2 

Unit 2 

3 

3 

3 

4 

7 

4 

4 

3 

4 

7 

Unit 3 

5 

5 

3 

4 

7 

6 

6 

3 

4 

7 

Unit 4 

7 

7 

3 

4 

7 

8 

8 

3 

4 

7 

Unit 5 

9 

9 

2 

2 

11 

10 

3 

4 

Team project 

(Assignment) 


10 

12 

Total 



31 

39 

82 


The students were asked to use the e-calendar on the course Web site and arrange all to 
week’s study time at the beginning of the 1 st week. The study time could be flexible on a 
weekly basis. The study time which students set would be automatically sent to them as a 
reminder. 
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Financial analysis. 

This involves budgeting various expenditures and income. The expenditures consist of 
five categories, which are course materials development (course content writing, editing, 
use of copyright materials, translation); e-learning instructional design (working hours of 
instructional and graphic designers); multimedia design and production (expert teaching, 
video programme shooting, offline editing, dubbing, use of DV); interactive courseware 
development; technical development (setting up the e-course platform, designing the 
course Web site, upload learning resources); and textbook and tutor fees. The income is 
tuition fees from students. It was estimated that the tuition fee from 60 students of the 1 st 
intake could cover all course design and development expenditures. 

Internal quality assurance analysis. 

This follows the quality assurance systems of HKU SPACE. For a short course, the internal 
quality assurance includes six parts: course development and approval, course monitoring, 
course review, quality process review, teaching quality, and teaching and learning support 
(HKU SPACE, 2009). 

Development Evaluation 

The first step in e-learning development evaluation is to analyze the course blueprint, which 
is compiled and prepared by the programme director. The blueprint deals with the forma¬ 
tion of the course team and its members’ roles, course background, course introduction, 
course objectives, learner analysis, requirements for learning facilities and skills, course 
modules/units, learning materials, assessment and examination, communication and col¬ 
laboration in learning, learner support services, teaching model(s), course materials writ¬ 
ing schedule, quality assurance, and copyright issues. 

When the course blueprint evaluation has been completed, it is followed by analyzing the 
construction of the e-learning platform and course Web site, instructional design, learning 
resources, assignment and examination arrangements, and the recruitment and training of 
tutorial staff. Table 3 lists the e-learning course development and evaluation steps. 
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Table 3 


E-Learning Course Development and Evaluation 


Course content 

Responsible organization 

Evaluation 

Course blueprint 

HKU SPACE 

Evaluation process: 

Course development team — Education 
subject unit — Academic Board of the College 
of Humanities and Law — Quality Assurance 
team — Registrar’s office - External asses¬ 
sors. 

Instructional 

design 

Learning re¬ 
sources 

Assignment and 

examination 

E-learning plat¬ 
form 

HKU SPACE 

Peking University School 
of Distance Learning for 
Medical Education 

Programme director; instructional designer; 
multimedia designer; multimedia producer; 
tutors; course external assessor 

Course Web site 

Financial analy¬ 
sis 

Registrar’s office; Financial Unit 

Tutors 

Programme director; external assessors 


Since this course was developed by HKU SPACE, the evaluation of the course blueprint, 
instructional design, learning resources, assignment and examination procedures followed 
the course development procedures of HKU SPACE. Outside experts were invited to do an 
external evaluation. The requirements for external experts were professors in education 
with at least 10 years experience in distance education research and teaching. 

In terms of instructional design, the ADDIE model was adapted with five phases: analysis, 
design, development, implementation, and evaluation (Jochems, van Merrienboer, & Ko- 
per, 2004, p. 55-56). The principle of seven types of interactions was also emphasized, 
including the interactions between students and interface, between students and teachers, 
among students, between students and learning content, between students and learning 
objectives, between students and multimedia learning resources, and between students and 
time management (Zhang, 2009). 

Since this course was launched in collaboration with SDLME, PKU and students were 
mainly from mainland China, the e-learning platform was developed on Medtime Open 
Learning System (MOLS), which was designed and developed by SDLME, PKU. The MOLS 
functions could be classified into five categories: course content functions, communication 
and collaboration functions, feedback and evaluation functions, assignment and assessment 
functions, and administration and management functions. Utilizing the MOLS e-learning 
platform and its technical staff lowered the cost of course development. 
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Tutors were recruited from mainland China, but HKU SPACE assessed their qualifications. 

Process Evaluation 

Process evaluation refers to evaluating the process of course delivery, including the 
overall evaluation, technical support, Web site utilization, learning interaction, resource 
utilization, learner support, assessment, and flexibility. Process evaluation mainly uses 
three approaches: survey of students’ learning experience and feedback; survey of tutors’ 
opinions; and programme director’s monitoring of the e-learning tutorials. 

The approach to understanding students’ learning experience and feedback is as follows: 
establishing a special feedback area on the course Web site, establishing email communica¬ 
tion between tutors and students, and internal reviewer or programme director’s interviews 
with tutors and students. For example, the students were asked to familiarize themselves 
with various functions of the e-learning platform in the first week, referring to the course 
Web site guidance. The students needed to report to their tutor their degree of familiarity 
and time spent for this purpose. It was found that all the students learnt to use this course 
platform in two to four hours. 

In the middle of this course, the reviewers and the programme director conducted forma¬ 
tive evaluation. For example, at the sixth week of this course, individual interviews were 
conducted and a virtual classroom was organized for evaluators to gather students’ learning 
feedback, including overall evaluation, learning experiences, difficulties, and suggestions 
so that timely adjustments could be made. For example, in the original course schedule, 
students were required to study 10 research methods within two weeks’ time, which was 
very difficult for most of them on a part-time study basis. The students suggested “select 
and master a few research methods in detail that were closely related to the work require¬ 
ment while achieving general understanding of the other research methods.” 

Considering that this was a short on-the-job training course without study credits, the 
change was made by the course team. Instead of applying each research method in general, 
the students were asked to choose two research methods in writing a research proposal as 
a group project. The assignments were revised accordingly for the 2 nd intake of students. 
However, for credit courses, changes must be approved by the quality assurance committees 
of HKU SPACE. 

Monitoring e-learning tutorials is one of the most important tasks for the programme di¬ 
rector, who needs to log into the course Web site at least once every two days to observe stu¬ 
dents’ learning progress and difficulties. If students’ questions are not answered promptly 
or only ambiguous answers are provided, or if there are not many posts in the discussion 
forum area, the programme director would take immediate action to contact the tutors and 
solve the problem and inspire student’s learning enthusiasm. 

Process evaluation is a meticulous process which involves continuous evaluation through¬ 
out the course. The programme director and tutors need to plan carefully to maintain stu¬ 
dents’ learning enthusiasm and help them achieve the final learning objectives. 
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Product Evaluation 

Product evaluation of an e-learning course is mainly conducted through quantitative re¬ 
search, supplemented with students’ feedback and suggestions. For the first intake of this 
e-learning course, the online questionnaire method was used and all 60 students were sur¬ 
veyed. Thirty-eight valid data sets were received; the response rate was 63%. 

Tables 4 to 6 show the students’ evaluation of course effectiveness, teaching effectiveness, 
and learning effectiveness. Table 4 shows the results of overall feedback on course 
effectiveness; such feedback is required for all short courses at HKU SPACE. Tables 5 and 6 
display the results of students’ evaluation of various e-learning components of the course. 

In order to understand these results relative to those of the face-to-face teaching mode, we 
adopted the evaluation statistics labels used for face-to-face teaching in HKU SPACE and 
calculated the average percentage of each item in the questionnaire survey on a Likert-type 
scale. The scale of the grades is explained as follows: o - 39.9 %, Fail; 40%- 49.9%, Pass; 
50%- 59.9%, Satisfied; 60% - 69.9%, Good; 70% - 74.9%, Very Good; 75% - 100%, Excel¬ 
lent. 

Table 4 

Overall Feedback on Course Effectiveness 


Overall feedback 

Strongly 

agree 

Agree 

Neutral 

Disagree 

Strongly 

disagree 

Average 

All things considered, the 
course has been effective 
in helping me learn 

26% 

66% 

8% 

0% 

0% 

80% 

All things considered, the 
teacher has been effective 
in helping me learn 

47 % 

47 % 

5 % 

0% 

0% 

86% 

Attending the course has 
been worthwhile 

82% 

16% 

3 % 

0% 

0% 

95 % 


Table 4 shows that students’ evaluation of learning effectiveness, teaching effectiveness, 
and course worth reached the level of “Excellent” using the same evaluation statistics meth¬ 
od for face-to-face teaching at HKU SPACE. 
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Table 5 

Students’ Degree of Satisfaction with the E-Learning Course (%) 



Strongly 

satisfied 

Satisfied 

Neutral 

Unsatisfied 

Strongly 

unsatisfied 

Average 

Web site design 

34 

53 

11 

3 

0 

79-9 

Virtual opening ceremony 

26 

63 

11 

0 

0 

78.9 

Lectures (video 
programme) 

63 

37 

0 

0 

0 

90.8 

Tutors 

68 

32 

0 

0 

0 

92.1 

E-learning course arrange¬ 
ment 

32 

55 

13 

0 

0 

79-6 

Instructional design 

42 

45 

13 

0 

0 

82.2 

Textbook 

50 

47 

3 

0 

0 

86.8 

E-learning study units 

34 

55 

11 

0 

0 

80.9 

Flexibility of learning 

39 

45 

16 

0 

0 

80.9 

Communication with the 

tutor 

45 

45 

11 

0 

0 

83.6 

Communication with stu¬ 
dents 

29 

37 

29 

5 

0 

72.4 

Technical support 

29 

50 

18 

3 

0 

76.3 

Assessment 

34 

53 

13 

0 

0 

80.3 

E-learning environment 

39 

45 

13 

0 

3 

79-6 

Course quality 

39 

53 

8 

0 

0 

82.9 


Vol 13 | No 3 


Research Articles 


June 2012 


77 




























Quality Assurance in E-Learning: PDPP Evaluation Model and its Application 


Zhang and Cheng 


Table 6 


Students’ Evaluation of Teaching Effectiveness (%) 



Strongly 

agree 

Agree 

Neutral 

Disagree 

Strongly 

disagree 

N/A 

Average 

Teaching pace was appropriate 
video programme 

55 

37 

8 

0 

0 

0 

86.8 

The lecturer was knowledgeable 
about the subject matter 

89 

11 

0 

0 

0 

0 

97-4 

The tutor was knowledgeable 
about the subject matter 

76 

18 

5 

0 

0 

0 

92.8 

The tutor explains clearly 

63 

26 

8 

3 

0 

0 

87-5 

The tutor encourages students to 
participate in e-learning discus¬ 
sion 

53 

37 

11 

0 

0 

0 

85-5 

The tutor stimulated my interest 
in the subject 

42 

42 

13 

0 

0 

3 

80.3 

The tutor has been effective in 
helping me to learn. 

42 

50 

8 

0 

0 

0 

83.6 


It can be seen in Tables 5 and 6 that student evaluation of degree of satisfaction, teaching 
products and learning products in e-learning components reached the level of “Excellent” 
based on the course evaluation criteria used at HKU SPACE. Table 5 shows that satisfaction 
with tutors was highest with an average score of 92.1, but communication with students 
was lowest with an average score of 72.4. In this course, the tutors were required to answer 
student questions within 48 hours and it was very much appreciated by the students. 
However, there were no requirements for students to respond to other students’ enquiries 
in discussion forums. Therefore, interaction between students was not so active compared 
with the interaction between tutors and students. 

Other Learning Outcomes 

The students also provided qualitative comments about the course in this e-learning course 
questionnaire. In summary, students mentioned two kinds of benefits besides the learning 
itself: personal experience of e-learning, which would be beneficial for their own devel¬ 
opment of e-learning courses or e-learning tutorials in the future, and acquaintance with 
many new friends from different places in their own teaching areas. The following are some 
of the most typical comments made by the students of this course: 
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The knowledge and skills I learnt from this course could 
improve my research quality greatly. Although I learnt 
courses on education research methods in Australia, only 
from this course can I really understand how to conduct 
educational research properly. 

I feel so lucky that I can study this course. Students are 
from different places. We can share our experiences with 
each other in the course website, with no restriction of 
time and place. 

I met some of my classmates from Inner Mongolia 
and Malaysia at the AAOU (Asian Association of Open 
Universities) conference. We had had a lot of discussions 
on the internet, but the first sight of the real person was 
still so exciting, just like seeing old friends after a long 
time. 

The e-learning study materials are so clear and interactive. 
It can serve as a good example for my own e-learning 
course development. 

Thanks to the enthusiasm and good examples of the staff 
tutor and tutors, I really enjoyed the e-learning learning 
environment of this course. 

Besides studying different research methods, I have 
also learned a lot about how to develop quality e-course 
materials and how to facilitate discussion forums 
effectively. 

Many thanks for Professor to develop and chair this 
course. Also thanks a lot for the passion and hard work 
of the tutors and other staff. This course has achieved 
better teaching and learning effectiveness than face to 
face instruction. In addition to those different research 
methods, I have also learned a lot about how to develop 
quality e-course materials and how to facilitate e-learning 
discussion effectively. Meanwhile, I also got to know 
many friends in the same field from different places. This 
e-learning course is definitely a good model and worthy 
of studying. 
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Sustainability. 

The success of this e-learning course has built up a good reputation. Many institutions 
have reserved places for their staff, and the long waiting list of potential students shows the 
course’s success, which ensures its sustainability. 


Conclusion 


The PDPP model for evaluating e-learning courses was designed and proposed based upon 
the CIPP evaluation model (i.e., planning evaluation, development evaluation, process eval¬ 
uation, and product evaluation.) In line with the characteristics and process of e-learning 
teaching and learning, 26 evaluation items were identified within the PDPP model. Using 
the PDPP model, the authors took the e-learning course on Research Methods in Distance 
Education as a case study to describe and analyze the series of evaluation activities. The 
research results show that this PDPP evaluation model could effectively ensure the qual¬ 
ity of the e-learning course in terms of both teaching and learning effectiveness. However, 
the use of the PDPP model in this study measures only one purely e-learning course and 
further studies are needed. The authors hope that this model could contribute to the 
e-learning quality assurance literature in the Chinese context and could be one reference in 
establishing e-learning quality assurance models for other educational institutions. 
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